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This brief is directed to researchers and adds to the research base about instructional 
practices that are related to student achievement. Additional evidence on these relationships can 
suggest specific hypotheses for the future study of such instructional practices, which, in turn, 
will provide research evidence that could inform professional development of teachers and the 
writing of instructional materials. The results of this study revealed a pattern of relationships 
largely consistent with earlier research, but not in every case. Results that are consistent with 
previous research include increased student achievement associated with teachers dedicating 
more time to whole-class instruction, suggesting specific practices in response to students ’ work 
(1st grade only), using more representations of mathematical ideas, asking the class if it agrees 
with a student's answer, directing students to help one another understand mathematics, and 
differentiating curriculum for students above grade level (2nd grade only). Less consistent 
results were found in three 2nd-grade results, and include lower achievement associated with 
teachers ’ higher frequency of eliciting multiple strategies and solutions; prompting a student to 
lead the class in a routine; and with students more frequently asking each other questions. These 
findings suggest that practices associated with higher achievement gains include both student- 
centered and teacher-directed practices; however, some student-centered practices were 
associated with lower achievement gains. 


How should teachers instruct young students in mathematics? Instructional practices have 
been proposed based on successful research projects (e.g., Clements and Sarama 2012; 
Montague and Jitendra 2012; National Mathematics Advisory Panel 2008; National Research 
Council 2009; Rohrer and Pashler 2010; Rosenshine 2012; National Association for the 
Education of Young Children 2013) and from observations of successful teachers (Lemov 2010). 
In addition to research suggesting practices that teachers should use, curricula by their nature 
also embody a set of instructional practices. 

Prior studies have examined the relationships between various instructional practices and 
student achievement, but uncertainty remains about which practices teachers should use. For 
example, some studies compared practices that often are classified as “teacher-directed” with 
those often classified as “student-centered.” Although some have argued that this is too simple a 
dichotomy (National Mathematics Advisory Panel 2008), we used it as a broad classificatory 
structure for two reasons. First and most important, the issue was prominent when the original 
study was designed. Indeed, it was the first issue addressed by the National Math Advisory 
Panel’s (2008) instructional practices subpanel (for other examples of research that moves 
beyond the dichotomy, see Bodovski and Farkas 2007; Cohen and Hill 2000; Guarino et al. 
2013; Fe et al. 2006). Second, we believed our analyses could shed light on the nuances of the 
instructional practices included in those two broad categories, thus helping the field to move 
beyond the dichotomy if results so warranted. 

The National Mathematics Advisory Panel (2008) defined teacher-directed instruction as 
“instruction in which primarily the teacher is communicating the mathematics to the students 
directly and in which the majority of interactions about the mathematics are between the teacher 
and the student” (pp. 6-14), and they defined student-centered instruction as “instruction in 
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which primarily students are doing the teaehing of the mathematics and that the majority of the 
interaetions about the mathematies oeeurs between and among students” (pp. 6-16). Some of 
these studies found that teacher-direeted praetiees led to greater student math achievement 
(Baker et al. 2002; Darch et al. 1984; Hopkins et al. 1997; Rittle- Johnson 2006), whereas other 
studies making similar eomparisons found that student-eentered praetiees were more effeetive 
(Bransford et al. 2000; Fuehs et al. 1995; Hiekey et al. 2001; Muthukrishna and Borkowski 1995; 
Slavin and Karweit 1985) or had mixed results (Fuehs et al. 2006). Differenees in findings and 
eonelusions eould be the result of important differences aeross the studies, including differences 
in the speeifie teaeher-directed and student-eentered praetiees examined. 

Purpose of this Brief 

This study builds on the research base by using correlational techniques to examine the 
relationships between a large number of speeifie instructional practices (39) and mathematies 
aehievement of 1st- and 2nd-grade students. The instruetional praetiees (deseribed in the 
following ehapter) are those used by teaehers who partieipated in a randomized eontrolled trial 
(RCT) of four mathematies eurrieula: (1) Investigations in Number, Data, and Spaee 
(Investigations); (2) Math Expressions; (3) Saxon Math; and (4) Scott Foresman- Addison 
Wesley Mathematics (SFAW).^ The four eurrieula use different approaehes to student 
instruetion, with differing levels of emphasis on various instruetional praetiees (a detailed 
deseription of each curriculum appears in the Appendix). Those relative emphases may have 
guided study teachers’ praetice in ways that resulted in different student achievement. 
Alternatively, eertain instruetional praetiees may have been relatively more effeetive, regardless 
of eurrieulum. 

The data from this study provide a unique opportunity to examine the relationship between 
individual instructional practices and student aehievement. Some of the advantages of these data 
inelude independent observations of the same praetiees aeross all elassrooms by observers not 
affiliated with any eurrieula approaeh; a highly reliable, individually administered student 
outcome assessment; a rich data set that ineludes eontrols for many eharaeteristics of students, 
teachers, schools, and classroom environments; and a large sample, to examine whether the uses 
and relationships (to aehievement) of the praetiees differ aeross 1st and 2nd grade. 
Charaeteristies of a grade may infiuenee the way teaehers use various praetiees. For example, 
students in 2nd grade may be able to work in groups, but sueh work may be more challenging for 
1st graders (e.g., the eognitive load of dealing both with social interactions and the mathematies 
may be more likely to overwhelm the information-proeessing system of the younger students). 
These data are also unique, in that most of the sehools and teaehers were implementing their 
assigned eurrieulum for the first time, so prior experienee with the recommended praetiees of 
each curriculum was comparable aeross teachers. Last, the random assignment of eurrieula to 
sehools (and thus to the aeeompanying reeommended praetiees within eaeh eurrieulum) also may 
help guard against unmeasured variables related to teaeher usage of partieular praetiees. 

The design of the study also has limitations relevant to interpreting the results. First and 
foremost, although the eurrieula were randomly assigned, the instruetional practices observed 
were not. Therefore, this is a eorrelational study whose results must be evaluated with eausal 
designs before implieations for praetiee ean be reliably drawn. Seeond, beeause there was limited 
variation in the use of some instruetional practices, it is possible that a subset of these practices 
may have a true relationship with student achievement that could not be deteeted in these data. A 
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third limitation is that the data were eolleeted in single day-observations in eaeh teacher’s 
classroom. Fourth, the observations recorded frequency but not the quality of implementation of 
the practices (see the discussion in Section II.A). Given these limitations, our results will be most 
useful in guiding hypotheses about relationships between specific instructional practices and 
student achievement. 

In the next section, we present details about the results; in the following section, we interpret 
our results in the context of the broader literature to suggest why apparent inconsistencies have 
arisen. Such interpretations may help researchers design causal studies to accurately identify 
practices that teachers should or should not implement in classroom instruction — this study, as 
with most of the existing research, is based only on correlations. In the final section, we 
summarize our conclusions on what the current body of knowledge (including our findings) 
suggests about aspects of instruction that may promote students’ learning of mathematics, and 
what research questions need to be addressed. 

Relationships Between Instructional Practices and Student Math Achievement 

Using data from the impact evaluation of four mathematics curricula, we examined the 
relationship between instructional practices and math achievement separately for students in 1st 
and 2nd grades. The Ist-grade sample includes 3,818 students from 364 classrooms across 108 
schools; the 2nd-grade sample includes 2,796 students from 269 classrooms across 71 schools. 
Compared with all U.S. elementary schools, those included in the analyses by design have higher 
fractions of low-income and minority students and are more urban. The Appendix provides more 
information about the characteristics of schools, teachers, and students in the analysis. 

Instructional Practices 

Using a protocol developed by the study team, we measured a large number of instructional 
practices in each study classroom. The observations were conducted in the 2006-07 or 2007-08 
schools years, during each school’s first year of curriculum implementation in the study. The 
observations occurred within schools that were randomly assigned to use one of the four study 
curricula in both 1st and 2nd grades; about a quarter of the observations were conducted in each 
of the four study curricula. 

The observation protocol includes nearly 100 items that were either thought to be useful by 
the study team for discriminating the instructional approaches of the study’s four curricula, or 
were practices with prior evidence suggesting they are related to student achievement. The items 
were coded during one day’s worth of math instruction in each study classroom that was 
observed in real time — this included the math lesson and the morning meeting or calendar time, 
which was typically about 70 minutes per day, on average. About two-thirds of the items on the 
protocol were coded during the observation; the remaining items were coded immediately after 
the observation. 

Observations of instructional practices were coded for frequency for two reasons. First and 
most important, low-inference observational measures are more reliable than high-inference 
measures (Brabeck et al. 2013, Campbell et al. 2004), and any introduction of Likert-based items 
rating quality would result in higher-inference items (as opposed to a simple count of the number 
of occurrences of each practice). Second, research in early mathematics education has not 
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reliably identified the eharaeteristies of low- and high-quality implementations of instruetional 
praetiees (for a review, see Hiebert and Grouws 2007). Therefore, we reeorded the frequeney of 
speeific practices to ascertain which are related to student achievement to guide future research 
that examines issues of quality and uses causal designs (which must identify a reasonable 
number of such practices to assign). More information about the development of the protocol is 
provided in the Appendix. 

Groups of items on the protocol were designed to measure different concepts from slightly 
different perspectives; however, the study team’s lack of prior experience using the protocol led 
the team to remain open to the possibility that the intended concepts may need to be revised once 
the observation data were examined. Thus, an exploratory factor analysis (EFA) was conducted 
by the study team to identify groupings. The EFA indicated that four factors underlie the 
observation data, and analyses indicated that scales developed for three of those factors were 
related to student achievement (Agodini et al. 2010). 

The practices examined in this analysis are the 39 items that underlie the three scales the 
study team found are related to student achievement while working on the curriculum impact 
analysis."^ One of the three scales measured practices that are typical in student-centered 
instructional settings, another measured practices typical in teacher-directed settings, and the last 
measured student interactions (peer collaboration) during math instruction. A fourth scale 
emerged from the EFA that included items about the classroom environment, such as the extent 
to which teachers need to manage student behavior. When calculating the relationship between 
each of the 39 practices and student achievement, we adjusted for the items in the classroom 
environment scale, as described below. ^ Agodini et al. (2010) provide more details about the 
process for constructing the scales. 

While the terms “student-centered” and “teacher-directed” instruction have been used to 
describe quite different instructional practices and environments in the literature, it is important 
to remember that these terms are also used to describe the 39 items that clustered together in the 
EFA. Thus, the items in each scale may differ from those classified a priori in other studies, such 
as the report of the National Mathematics Advisory Panel (2008). 

In Table 1, we list the 39 instructional practices examined, along with the various ways the 
items were coded. Most items asked observers to tally the frequency of the practice because the 
study’s four curricula differ in the extent to which these practices are used. For these items, 
observers were instructed to stop tallying practices once the practice was observed 21 times. The 
cut-off was established for a variety of reasons, including limiting the burden placed on 
observers (see the Appendix for further information). The remaining items asked observers to 
indicate whether the practice did or did not occur (a yes/no coding) or the extent to which a 
statement (such as “students help one another understand math concepts or procedures”) is 
characteristic of the class, because such coding of these items was considered sufficient for 
differentiating the study’s curricula. The Appendix and Agodini et al. (2010) provide more 
details about the classroom observations. 
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Table 1. Instructional Practices in the Anaiysis 


Possible 

Item Measurement Range 

Items in the Student-Centered Instruction Scale 


Teacher poses open-ended questions that have more than one correct answer 
Number of problems for which the teacher elicits multiple strategies or solutions 
Teacher tells student the strategy to use in response to student work/answer 
Teacher elicits other students’ questions about a student’s response 
Teacher labels math strategy, problem, or concept in response to student work/answer 
Teacher repeats student answer in a neutral way with no indication of correctness 
Teacher probes for reasoning or justification in response to student work/answer 
Teacher provides hint to students in response to student work/answer 
Teacher clarifies what student says or does in response to student work/answer 
Teacher extends what student says or does in response to student work/answer 
Teacher uses praise or makes positive comments focused on content 
Teacher highlights student work or solution to class 

Number of different types of visual or three-dimensional representations created by students 
Teacher differentiates curriculum for children who are above grade level 

Items in the Teacher-Directed Instruction Scale 

Teacher asks close-ended questions 

Number of problems for which the teacher guides practice on problems 
Number of representations demonstrated by the teacher 

Teacher indicates if correct without elaborating in response to student work/answer 

Teacher calls on other students until the correct answer is given 

Teacher asks class if it agrees or disagrees with a student’s response 

Teacher prompts student to guide practice or lead the class in a routine 

Students practice number facts or procedures 

Students provide choral or group responses to questions 

Students rote count (orally or in writing) 

Number of types of rote counting that occurred, by ones, by twos, and so forth 
Number of practice problems focusing on review of previously learned material 
Number of materials used by children 

Number of types of representations used during math, by the teacher or by students 
Percentage of math instructional time spent in large group 

Items in the Peer Collaboration Scaie 

Teacher demonstrates how to play a game 

Teacher directs or encourages students to help one another with math 

Students play math games 

Students ask peers questions about math 

Students discuss math strategies or solutions with partner or small group 
Percentage of math instructional time spent in small group 
Percentage of math instructional time spent in pairs 
Teacher encourages students to help one another understand math 
Students help one another understand math concepts or procedures 
Peer-to-peer interaction about math occurs 


Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Scale 

1^ 


Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Tally 

0-21 

Yes/No 

0-1 

Scale 

0-6 

Scale 

0-2 

Yes/No 

0-1 

Check Box 

0-8 

Tally 

0-21 

Check Box 

0-11 

Check Box 

0-7 

Scale 

0^ 


Yes/No 

0-1 

Yes/No 

0-1 

Scale 

0-6 

Scale 

0-2 

Scale 

0-2 

Scale 

0^ 

Scale 

0^ 

Scale 

1^ 

Scale 

1^ 

Scale 

1^ 
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Because the coding scheme for the items supports frequency rather than quality of 
implementation of the practices (a limitation of the study), the practices may have been displayed 
across a range of implementation quality. In addition, for most items on the observation protocol, 
the frequency of observed practices is a function of the length of the lesson. Thus, our results 
will be most useful in guiding hypotheses about relationships between specific instructional 
practices and student achievement. 

Student Math Achievement 

Students’ math achievement was measured by the study team administering the math 
assessment developed for the Early Childhood Longitudinal Study-Kindergarten Class of 1998- 
1999 (ECLS-K). The ECLS-K assessment is an adaptive and nationally normed test that meets 
accepted standards of validity and reliability (Rock and Pollack 2002). It also meets other 
important study requirements, including individual administration, ability to measure 
achievement gains over the study’s grade range, and accuracy in capturing achievement of 
students from a wide range of backgrounds and ability levels. More details about the assessment, 
including reliability information for the study sample, appear in the Appendix. 

Students were tested in both the fall and spring of the school year during which they 
participated in the study (2006-07 or 2007-08). The ECLS-K K-1 math assessment was 
administered to 1st graders. An ECLS-K math assessment for the 2nd grade did not exist; 
therefore, the study team worked with the Educational Testing Service (ETS), the developer of 
the ECLS-K, to create a 2nd-grade assessment by selecting appropriate items from existing 
ECLS-K math assessments (including the K-1, 3rd- , and 5th-grade instruments). ETS used 
information from the ECLS-K bridge study, ^ which included a small sample of 2nd graders, 
combined with information about the current study’s sample, to ensure that the administered 
items appropriately targeted the estimated range of 2nd graders’ ability levels.^ The study also 
used a Spanish version of the assessment for any classes in which math instruction was 
conducted entirely in Spanish. 

Analytic Approach 

We used a two-step process to identify the instructional practices related to student 
achievement. The first step examined how each practice is related to student achievement when 
taking into account the statistical influence of other practices in the same scale. This involved 
three analyses — one for each set of items in the three scales that emerged from the EEA analyses 
of classroom observation data. For example, we examined the relationship between teacher use 
of open-ended questions (one of the 14 practices in the student-centered scale) and student 
achievement, adjusted for all other practices in the student-centered scale. Similarly, for the other 
two analyses, we examined the relationship between student achievement and the practices in the 
teacher-directed scale (15 items) and those in the peer collaboration scale (10 items). Each set of 
first-step results is adjusted for characteristics of schools, teachers, and students (including 
earlier achievement) and aspects of the classroom environment (such as the extent to which 

o 

teachers managed student behavior). 

The second step involved an analysis that examined how practices identified in the first step 
relate to student achievement when such practices are considered simultaneously. Given that 
teachers frequently use practices from more than one instructional scale, the simultaneous 
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consideration of those practiees in each scale that eorrelate with student aehievement may 
suggest those that matter in real-life situations. For example, suppose that the first step of the 
analysis shows that only one student-centered practice and one teacher-directed practice are 
significantly related to student achievement: teacher use of open- and close-ended questions. The 
second step would then examine the relationship between open-ended questions and student 
aehievement adjusted for close-ended questions, and viee versa. As with the first-step results, the 
second-step results are adjusted for characteristics of schools, teachers, and students and aspects 
of the classroom environment.^ 

We conducted all analyses separately for 1st- and 2nd-grade students for two main reasons. 
First, we did so because the relationship of the instructional practices could depend on student 
maturity (e.g., the capacity to attend both to eontent and social-cognitive demands of produetive 
cooperative learning change substantially over the early years (Nastasi and Clements 1991)). 
Second, the mathematical focus of the grade level is different, with new emphases on 
mathematical structures, such as units in place value and length measure, emerging in 2nd grade. 
The Appendix ineludes more details about the analytic approach. 

We used this analytic approach because practices that are consistent with a particular 
instructional approach, such as teacher-directed practices, tend to co-occur. But, within a set of 
practices, there may be ones that are and are not related to student achievement. Including in 
each of the first-step analyses all the praetiees that are consistent with a partieular approaeh may 
help identify the ones in each domain that have the greatest correlation with achievement. The 
second step then examines which of the identified practices in the various domains have the 
greatest correlation with aehievement. 

Limitations of the Analysis 

It is important to note three limitations of our analysis. First, the analytic approach does not 
support causal statements about the achievement effect of the examined practices. Teachers who 
used eertain instructional practices may differ in ways that affect achievement but are not 
contained in our data source; therefore, we eould not account for these differenees when 
examining the relationship between the practices and student achievement. For example, a 
practice associated with an increase in student achievement could reflect not only the effect of 
the practice but also the possibility that more effeetive teaehers adopted the practice — and we did 
not measure teacher effectiveness. However, as Hiebert and Grouws (2007, p. 397) stated, 
correlation approaches “can help to identify features of teaching that might have major effects on 
learning and deserve further study, and they can provide descriptive data to inform the 
development of hypotheses regarding teacher-learning relationships.” 

Second, there is limited variation in the use of some instructional practices, so it is possible 
that a subset of these practices may have a true relationship with student achievement that could 
not be deteeted in these data. One reason for the limited variation could be due to the way in 
which some items were coded. For example, as mentioned, items tallied by observers were top 
coded to 21 if teaehers exhibited those praetiees at least 21 times, thus introducing a ceiling on 
the tallies. As shown in Table 2, about 95 percent of teachers received the maximum code for the 
item that tallied the number of times a teacher asked a close-ended question. Our finding in this 
brief (described below) that this teacher practice is not related to student achievement eould be 
due to the limited variation in the practice brought on by our approach for coding the item. 
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Another reason for the limited variation for some items could be due to the influence of the 
curricula included in the RCT on teachers’ practices. As mentioned in Agodini et al. (2010), 
nearly all teachers reported use of the curriculum assigned to their schools. Therefore, practices 
that are not part, or are a minor part, of the study’s curricula may have a low frequency of use. A 
final reason for the limited variation for some items is that most teachers were using the 
curriculum in the RCT for the first time when classroom observations were conducted. During 
the first year of curriculum implementation, teachers may be learning to implement the structure 
and procedures of the curriculum and may not implement all parts (or the more sophisticated 
parts) of the curriculum until they gain experience and reach a more refined phase of 
implementation. Therefore, more challenging practices may have a low frequency of use. 

Third, the data were collected in single-day observations in each teacher’s classroom. All 
Ist-grade observations occurred in the spring of the school year, and the 2nd-grade observations 
were conducted in fall, winter, and spring. However, as single-day observations, they do not 
necessarily reflect teacher practice across the entire school year. In addition, the observations 
were conducted in real time, so observers could not “replay” an interaction to see if a practice 
occurred. This could result in measurement error, which could weaken the correlations. Given 
these limitations, the results presented in the following section are best interpreted as suggesting 
hypotheses for further study. 

Results 

In Tables 3 through 5, we present results from the first step and, in Table 6, results from the 
second step; we focus on results from the second step. In both steps, practices that are 
statistically significant at the 0.10 level are deemed to be associated with student achievement. 
We use the 0.10 level of statistical significance rather than 0.05 to avoid false conclusions about 
practices that may be related to student achievement but do not reach the conventional level 
because of little variation in our data. ^ ^ Considering the correlational design of this study and the 
exploratory nature of the results, we suggest that each of our findings be explored with causal 
designs. Given that researchers will most likely study only those practices that are associated 
with achievement, we believe it is important to minimize Type II error (failing to detect 
associations), even though this may lead to increased Type I error (detecting associations that 
really do not exist), so more rigorous future research does not overlook practices that are 
potentially important for student achievement. 
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Table 2. Instructional Practices 


Percentile 


Item 

Average 

Minimum 

25th 

50'^ 

75th 

Maximum 

Items in the Student-Centered Instruction Scaie 

Teacher poses open-ended questions that have more than one correct answer (TALLY) 

6.18 

0 

1 

4 

9 

21 

Number of problems for which the teacher elicits multiple strategies or solutions (TALLY) 

1.83 

0 

0 

1 

3 

11 

Teacher tells student the strategy to use in response to student work/answer (TALLY) 

1.39 

0 

0 

1 

2 

21 

Teacher elicits other students’ questions about a student’s response (TALLY) 

0.18 

0 

0 

0 

0 

6 

Teacher labels math strategy, problem, or concept in response to student work/answer (TALLY) 

1.39 

0 

0 

0 

2 

21 

Teacher repeats student answer in a neutral way with no indication of correctness (TALLY) 

1.56 

0 

0 

0 

2 

21 

Teacher probes for reasoning or justification in response to student work/answer (TALLY) 

4.71 

0 

1 

4 

7 

21 

Teacher provides hint to students in response to student work/answer (TALLY) 

6.74 

0 

2 

5 

9 

21 

Teacher clarifies what student says or does in response to student work/answer (TALLY) 

1.69 

0 

0 

1 

2 

21 

Teacher extends what student says or does in response to student work/answer (TALLY) 

0.63 

0 

0 

0 

1 

21 

Teacher uses praise or makes positive comments focused on content (TALLY) 

1.96 

0 

0 

1 

3 

21 

Teacher highlights student work or solution to class (TALLY) 

0.98 

0 

0 

0 

1 

21 

Number of different types of visual or three-dimensional representations created by students (TALLY) 

2.13 

0 

1 

2 

3 

15 

Teacher differentiates curriculum for children who are above level (SCALE, 1-4) 

1.16 

1 

1 

1 

1 

4 

Items in the Teacher-Directed Instruction Scale 

Teacher asks close-ended questions (TALLY) 

20.14 

1 

21 

21 

21 

21 

Number of problems on which the teacher guides practice on problems (TALLY) 

9.19 

0 

4 

8 

14 

21 

Number of representations demonstrated by the teacher (TALLY) 

7.38 

0 

3 

6 

10 

21 

Teacher indicates if correct without elaborating in response to student work/answer (TALLY) 

18.93 

0 

21 

21 

21 

21 

Teacher calls on other students until the correct answer is given (TALLY) 

2.67 

0 

0 

2 

4 

21 

Teacher asks class if it agrees or disagrees with a student’s response (TALLY) 

2.19 

0 

0 

1 

3 

21 

Teacher prompts student to guide practice or lead the class in a routine (YES/NO) 

0.33 

0 

0 

0 

1 

1 

Students practice number facts or procedures (SCALE, 1-6) 

3.37 

0 

0 

6 

6 

6 

Students provide choral or group responses to questions (SCALE, 0-2) 

1.27 

0 

1 

1 

2 

2 

Students rote count (orally or in writing) (YES/NO) 

0.63 

0 

0 

1 

1 

1 

Number of types of rote counting that occurred, by ones, by twos, and so forth (TOTAL OF 8 TIMES) 

1.78 

0 

0 

2 

3 

7 

Number of practice problems focusing on review of previously learned material (TALLY) 

7.01 

0 

0 

4 

11 

21 

Number of materials used by children (TOTAL OF 1 1 ITEMS) 

1.67 

0 

1 

2 

2 

6 

Number of types of representations used during math, by the teacher or by students (TOTAL OF 7 ITEMS) 

2.26 

0 

1 

2 

3 

7 

Percentage of math instructional time spent in large group (SCALE, 0-4) 

3.11 

0 

3 

3 

4 

4 
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Table 2 (continued) 


Item 

Average 

Minimum 

25th 

Percentile 

50'^ 

75th 

Maximum 

Items in the Peer Collaboration Scale 

Teacher demonstrates how to play a game (YES/NO) 

0.15 

0 

0 

0 

0 

1 

Teacher directs or encourages students to help one another with math (YES/NO) 

0.41 

0 

0 

0 

1 

1 

Students play math games (SCALE, 0-6) 

1.18 

0 

0 

0 

0 

6 

Students ask peers questions about math (SCALE, 0-2) 

0.39 

0 

0 

0 

1 

2 

Students discuss math strategies or solutions with partner or small group (SCALE, 0-2) 

0.48 

0 

0 

0 

1 

2 

Percentage of math instructional time spent in small group (SCALE, 0^) 

0.25 

0 

0 

0 

0 

4 

Percentage of math instructional time spent in pairs (SCALE, 0-4) 

0.51 

0 

0 

0 

1 

4 

Teacher encourages students to help one another understand math (SCALE, 1-4) 

1.72 

1 

1 

1 

2 

4 

Students help one another understand math concepts or procedures (SCALE, 1-4) 

1.78 

1 

1 

2 

2 

4 

Peer-to-peer interaction about math occurs (SCALE, 1-4) 

1.71 

1 

1 

2 

2 

4 


Source: Author calculations (means and quartile ranges) using classroom observation data. 

Note: TALLY has a possible range of 0-21 , where 21 includes tallies of 21 and over. 
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Table 3. Practices in the Student-Centered Scale: Percentile-Point Increase in Student Achievement Associated with a One-Unit Increase 
in Each Practice (Step One Results) 


1st Grade 2nd Grade 


Item 

Estimate 

p-value 

Estimate 

p-value 

Teacher poses open-ended questions that have more than one correct answer (TALLY) 

-0.1 

0.52 

0.2* 

0.06 

Number of problems for which the teacher elicits multiple strategies or solutions (TALLY) 

0.0 

0.95 

-0.8" 

0.04 

Teacher tells student the strategy to use in response to student work/answer (TALLY) 

0.8" 

0.03 

-0.1 

0.66 

Teacher elicits other students’ questions about a student’s response (TALLY) 

-0.8 

0.49 

0.8 

0.33 

Teacher labels math strategy, problem, or concept in response to student work/answer (TALLY) 

0.5 

0.12 

0.2 

0.42 

Teacher repeats student answer in a neutral way with no indication of correctness (TALLY) 

-0.3 

0.19 

-0.4* 

0.08 

Teacher probes for reasoning or justification in response to student work/answer (TALLY) 

0.0 

0.87 

0.1 

0.62 

Teacher provides hint to students in response to student work/answer (TALLY) 

-0.2* 

0.10 

0.1 

0.23 

Teacher clarifies what student says or does in response to student work/answer (TALLY) 

0.2 

0.61 

-0.1 

0.69 

Teacher extends what student says or does in response to student work/answer (TALLY) 

0.2 

0.67 

-0.1 

0.86 

Teacher uses praise or makes positive comments focused on content (TALLY) 

0.0 

0.88 

0.2 

0.48 

Teacher highlights student work or solution to class (TALLY) 

0.2 

0.45 

0.1 

0.71 

Number of different types of visual or three-dimensional representations created by students (TALLY) 

0.3 

0.44 

0.2 

0.57 

Teacher differentiates curriculum for children who are above grade level (SCALE, 1-4) 

-1.3 

0.33 

1.8* 

0.09 


Source: Author calculations using data from the fall and spring ECLS-K math test administered by the study team, classroom observations conducted by the study team, teacher 

surveys data collected by the study team, and Common Core Data. 

Note: TALLY has a possible range of 0-21 , where 21 includes tallies of 21 and over. The estimates were produced using a three-level hierarchical learning model (HLM); a list of 

covariates is provided in the Appendix. 

'Significantly different from zero at the 0.10 level, two-tailed test. 

"Significantly different from zero at the 0.05 level, two-tailed test. 

"‘Significantly different from zero at the 0.01 level, two-tailed test. 
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Table 4. Practices in the Teacher-Directed Scale: Percentile Point Increase in Student Achievement Associated with a One-Unit Increase 


in Each Practice (Step One Results) 


Item 

1 St Grade 

Estimate p-value 

2nd Grade 

Estimate p-value 

Teacher asks close-ended questions (TALLY) 

-0.1 

0.76 

0.0 

0.86 

Number of problems on which the teacher guides practice on problems (TALLY) 

0.0 

0.84 

0.0 

0.91 

Number of representations demonstrated by the teacher (TALLY) 

0.0 

0.92 

0.3’ 

0.08 

Teacher indicates if correct without elaborating in response to student work/answer (TALLY) 

0.1 

0.79 

0.2 

0.34 

Teacher calls on other students until the correct answer is given (TALLY) 

-0.3’ 

0.09 

0.0 

0.90 

Teacher asks class if it agrees or disagrees with a student’s response (TALLY) 

0.1 

0.54 

0.3’ 

0.08 

Teacher prompts student to guide practice or lead the class in a routine (YES/NO) 

-1.2 

0.39 

-3.0’ 

0.05 

Students practice number facts or procedures (SCALE, 1-6) 

-0.2 

0.43 

0.2 

0.44 

Students provide choral or group responses to questions (SCALE, 0-2) 

-0.9 

0.39 

-1.4 

0.16 

Students rote count (orally or in writing) (YES/NO) 

-0.2 

0.91 

-1.3 

0.47 

Number of types of rote counting that occurred, by ones, by twos, and so forth (TOTAL OF 8 TIMES) 

0.7 

0.30 

0.7 

0.36 

Number of practice problems focusing on review of previously learned material (TALLY) 

0.2 

0.11 

0.0 

0.76 

Number of materials used by children (TOTAL OF 1 1 ITEMS) 

-1.0 

0.13 

0.1 

0.92 

Number of types of representations used during math, by teacher or students (TOTAL OF 7 ITEMS) 

0.0 

0.95 

0.1 

0.86 

Percentage of math instructional time spent in large group (SCALE, 0^) 

1.5” 

0.04 

-0.4 

0.54 


Source: Author calculations using data from the fall and spring ECLS-K math test administered by the study team, classroom observations conducted by the study team, teacher 

surveys data collected by the study team, and Common Core Data. 

Note: TALLY has a possible range of 0-21 , where 21 includes tallies of 21 and over. The estimates were produced using a three-level HLM; a list of covariates is provided in the 

Appendix. 

’Significantly different from zero at the 0.10 level, two-tailed test. 

’’Significantly different from zero at the 0.05 level, two-tailed test. 

’’’Significantly different from zero at the 0.01 level, two-tailed test. 
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Table 5. Practices in the Peer Collaboration Scale: Percentile Point Increase in Student Achievement Associated with a One-Unit 


Increase in Each Practice (Step One Results) 


Item 

1st Grade 

Estimate p-value 

2nd Grade 

Estimate p-value 

Teacher demonstrates how to play a game (YES/NO) 

1.6 

0.56 

4.3 

0.14 

Teacher directs or encourages students to help one another with math (YES/NO) 

1.2 

0.43 

1.0 

0.54 

Students play math games (SCALE, 0-6) 

-0.5 

0.26 

-0.3 

0.48 

Students ask peers questions about math (SCALE, 0-2) 

0.0 

0.99 

_4 2*** 

0.01 

Students discuss math strategies or solutions with partner or small group (SCALE, 0-2) 

1.7 

0.25 

-0.9 

0.52 

Percentage of math instructional time spent in small group (SCALE, 0^) 

-0.6 

0.56 

-0.2 

0.83 

Percentage of math instructional time spent in pairs (SCALE, 0^) 

0.8 

0.37 

0.6 

0.53 

Teacher encourages students to help one another understand math (SCALE, 1-4) 

0.3 

0.78 

1.2 

0.36 

Students help one another understand math concepts or procedures (SCALE, 1-4) 

-2.4* 

0.10 

2.3‘ 

0.08 

Peer-to-peer interaction about math occurs (SCALE, 1-4) 

-0.9 

0.50 

-1.6 

0.28 


Source: Author calculations using data from the fall and spring ECLS-K math test administered by the study team, classroom observations conducted by the study 

team, teacher surveys data collected by the study team, and Common Core Data. 

Note: The estimates were produced using a three-level HLM; a list of covariates is provided in the Appendix. 

‘Significantly different from zero at the 0.10 level, two-tailed test. 

“Significantly different from zero at the 0.05 level, two-tailed test. 

‘“Significantly different from zero at the 0.01 level, two-tailed test. 
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In the 1st grade, greater use of the following practices is associated with an increase in math 
achievement (Table 6): 

• Teachers telling students the strategy to use in response to students’ work or answers 

• Higher percentage of math instructional time spent in a large-group or whole-class 
setting 

In the 2nd grade, greater use of the following practices is associated with an increase in math 
achievement: 

• Teachers differentiating curriculum for children who are above grade level. 

• Number of representations that teachers demonstrate 

• Teachers asking the class if it agrees with a student’s answer 

• Students help one another understand math concepts or procedures 

Unlike the case of the Ist-grade results, however, some practices in 2nd grade are associated 
with a decrease in math achievement, including: 

• Teachers eliciting multiple strategies or solutions 

• Teachers prompting a student to guide practice or lead the class in a routine 

• Frequency of students asking one another questions about math 

A description of how each of these items was coded is provided in the Appendix. 

Placing Our Results in Context With the Findings of Simiiar Studies 

A relatively large body of research has attempted to identify instructional practices related to 
student achievement (e.g., Hiebert and Grouws 2007). However, this research has faced many 
difficulties because many factors, both inside and outside the classroom, are likely to affect 
student achievement. Much of the earlier research is based on correlational methods similar to 
those used in the current study, and those methods may not adequately account for all the factors 
affecting student achievement. In addition, even though some of the earlier research used 
rigorous methods (such as random assignment to specific practices), such research is sparse and 
can involve small sample sizes. This study has the advantages of a large and rich data set, 
independent observations of the same practices across classrooms randomly assigned to different 
curricula, and a reliable and valid student outcome assessment. However, because the practices 
themselves were not randomly assigned, the usefulness of the findings lies mainly in suggesting 
hypotheses for further study. 
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Table 6. Step Two Results: Percentile Point Increase In Student Achievement Associated with a 
One-Unit Increase in the Practices Identified in Step One (Tables 3, 4, and 5) 

Item Estimate p-value 

1st Grade 

Teacher tells student the strategy to use in response to student work/answer (TALLY) 0.9** 0.01 

Teacher provides hint to students in response to student work/answer (TALLY) -0.2 0.18 

Teacher calls on other students until the correct answer is given (TALLY) -0.3 0.16 

Percentage of math instructional time spent in large group (SCALE, 0-4) 1 .4** 0.04 

Students help one another understand math concepts or procedures (SCALE, 1-4) -1 .0 0.24 

2nd Grade 

Teacher poses open-ended questions that have more than one correct answer (TALLY) 0.2 0.14 

Number of problems for which the teacher elicits multiple strategies or solutions (TALLY) -0.7* 0.08 

Teacher repeats student answer in a neutral way with no indication of correctness (TALLY) -0.3 0.18 

Teacher differentiates curriculum for children who are above grade level (SCALE, 1-4) 3.0*** 0.01 

Number of representations demonstrated by the teacher (TALLY) 0.3** 0.02 

Teacher asks class if it agrees or disagrees with a student’s response (TALLY) 0.3* 0.05 

Teacher prompts student to guide practice or lead the class in a routine (YES/NO) -2.7* 0.07 

Students ask peers questions about math (SCALE, 0-2) .4 /I*** g.OO 

Students help one another understand math concepts or procedures (SCALE, 1-4) 2.1** 0.02 


Source: Author calculations using data from the fall and spring ECLS-K math test administered by the study team, classroom 

observations conducted by the study team, teacher surveys data collected by the study team, and Common Core Data. 

Note: TALLY has a possible range of 0-21, where 21 includes tallies of 21 and over. The estimates were produced using a three- 
level HLM; a list of covariates is provided in the Appendix. 

‘Significantly different from zero at the 0.10 level, two-tailed test. 

“Significantly different from zero at the 0.05 level, two-tailed test. 

“‘Significantly different from zero at the 0.01 level, two-tailed test. 
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To serve that purpose as well as possible, we plaee our results in the eontext of the findings 
of other studies that focused on the relationships between instructional practices and student 
achievement. In this way, we hope to enhance this research base and suggest specific hypotheses, 
with the goal of helping researchers design studies that will identify practices teachers should 
implement or avoid in their classroom instruction. Therefore, we examine what the body of 
knowledge (including our findings) suggests as hypotheses to pursue in establishing relationships 
between particular practices and student achievement. 

As the discussion below explains, some of our findings are consistent with earlier research, 
whereas other findings are inconsistent. When possible, we note whether our findings are 
consistent or inconsistent with research that draws on more rigorous methods. In addition, we 
highlight instructional practices for which the research base seems to be nearing a consensus and 
discuss what the findings may mean for instruction, professional development, and curriculum 
development and refinement, if validated by experimental means. 

Findings Consistent with Earlier Research 

Move beyond a simple student-centered/teacher-directed dichotomy. One main finding that 
is consistent with earlier research is that the categorization into student-centered versus teacher- 
directed may not be a dichotomy on which researchers should base future studies. That is, our 
results are congruous with the conclusion of the National Mathematics Advisory Panel; “High- 
quality research does not support the contention that instruction should be either entirely 
‘student-centered’ or ‘teacher-directed.’ Research indicates that some forms of particular 
instructional practices can have a positive impact under specified conditions” (2008, p. 11). 
Therefore, we will not make recommendations for studies that compare those broad categories of 
approaches, but rather will focus on hypotheses regarding which student-centered and teacher- 
directed practices appear to either warrant experimental validation (because they appear 
promising from the present research base) or need further research to resolve conflicting 
evidentiary claims or alternative interpretations. 

Large group or whole-class instruction is useful. The finding that an increase in the 
percentage of math instructional time spent in a large group or whole-class setting is associated 
with an increase in math achievement has at least two possible interpretations. First, it may 
reflect the positive effects of active teaching, which features the teacher’s presentation of what is 
to be learned and provision of individual feedback (Brophy 1988; Good et al. 1983). This finding 
would be consistent with the finding of a negative relationship between math achievement and 
the frequency with which teachers prompt a student to lead the class. Second, the positive 
relationship between a large group or whole-class setting and math achievement may also simply 
indicate that students in classes with more whole-class time devoted to math experience more 
instructional time in math (“time on task”; Bodovski and Farkas 2007; Brophy 1988; Pianta et al. 
2008; Sylva et al. 2005; Wenglinsky 2004). 

Future research could investigate the two potential interpretations and examine when other 
pedagogical structures (i.e., size and nature of student groups and the instructional practices used 
in each grouping) are, or are not, useful. For example, guided small groups — those in which a 
teacher is present, leading, monitoring, and guiding children’s work — may complement whole- 
group instruction, but only if the tasks assigned to students guide them to productive engagement 
with important mathematical concepts and procedures (Hiebert and Grouws 2007). 
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Representations are useful if used appropriately. The study’s results also address teachers’ 
practices during instructional time and how those practices relate to student achievement. For 
example, we find that the more 2nd-grade teachers demonstrated representations of mathematical 
ideas, the greater the increase in student achievement. The result suggests the hypothesis that 
curricula and professional development will be more effective if they emphasize that aspect of 
“pedagogical content knowledge”: 

[A] “particular form of content knowledge that embodies the aspects of content most 
germane to its teachability. . .[including] the most useful forms of representation of 
those ideas, the most powerful analogies, illustrations, examples, explanations, and 
demonstrations — in a word, the ways of representing and formulating the subject that 
make it comprehensible to others. Since there are no single most powerful forms of 
representation, the teacher must have at hand a veritable armamentarium of alternative 
forms of representation, some of which derive from research whereas others originate 
in the wisdom of practice” (Shulman 1986, p. 9). 

However, a specific caveat is in order. The present study’s data on representations simply 
measures the number of representations, not the quality or appropriateness of the representations. 
Teachers may have used some representations that were powerful and others that were not. The 
use of more representations may just have increased the likelihood that some of them were 
powerful. It is possible that targeted use of a smaller number of effective representations may be 
as beneficial as the use of a larger number of representations. Future research could first evaluate 
the effectiveness of different representations and then address the effects of different numbers of 
those shown to be efficacious. Research could also help identify the most effective 
representations. 

It may be useful to structure students’ strategies for particular learning objectives. A 
related issue involves the strategies children use and are taught to use. Most 1st graders and 
many 2nd graders are forming a collection of mathematical strategies for solving problems and 
figuring out arithmetic combinations (Sarama and Clements 2009). Our results suggest the 
hypothesis that it might be helpful for teachers to suggest specific strategies in response to 
students’ work (such as has been shown to be successful in Japan and the U.S. (Henry and 
Brown 2008; Murata and Fuson 2006). 

Students interacting and thinking about one another’s work may be important. Also 
consistent with other research, our results demonstrate a positive relationship between teachers 
asking the class if it agrees with a student’s answer and student achievement. Several researchers 
(Clements and Sarama 2009; Kamii and Dominick 1997) and position statements, such as the 
Curriculum Focal Points (National Council of Teachers of Mathematics 2006) and the Common 
Core State Standards (CCSSO/NGA 2010), suggest that students should “develop, discuss, and 
use” strategies to solve problems (e.g., Baroody and Rosu 2004). A careful analysis of survey 
data concluded that having 1st graders work problems and explain their problem solving is 
associated with (and probably causes) increased mathematics achievement in 1st grade (Guarino 
et al. 2013). Teachers promote discussion among students about these strategies by asking them 
to agree or disagree with a given student’s answer (Kamii and Dominick 1997), and provide 
mathematical structure and language when appropriate. Alternatively, the agreement with a 
student’s answer could be a method for more actively involving or focusing students when it is 
not their turn to solve a problem in large group. Future research will need to ascertain if such 
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discussion — beyond simple agreement with an answer — is a factor in the association found in the 
present study and whether speeific interventions can engender sueh facilitative diseussion. 

Differentiating instruction increases achievement of higher-performing students. Another 
finding consistent with earlier research demonstrates that an increase in differentiating 
eurrieulum for students who are above grade level is assoeiated with an increase in student 
aehievement. This is eonsistent with the finding of the National Mathematies Advisory Panel 
(2008), which reviewed studies on differentiating instruction for students who are gifted in 
mathematics and concluded that such differentiation benefits these students. The practice in the 
eurrent analysis was eharaeterized as “Teaeher differentiates curriculum for children who are 
above grade level.” Based on the results of this analysis, differentiation is a praetiee that prediets 
achievement (statistically significant in 2nd grade); however, it is a low-occurrence practice in 
this study’s data. Accordingly, differentiation may be a particularly important practice if it 
relates to achievement gains, even when used infrequently. Moreover, the low rate of 
differentiation is eonsistent with the literature on higher-eompetence students and thus has 
implications for professional development. For example, in one study, observations of early 
childhood teachers show that such teachers usually misjudge children’s level of mathematical 
thinking and therefore give praetiee (“more of the same”) problems even when they intend to 
provide learning opportunities (challenging problems), especially to the highest-performing 
children (Bennett et al. 1984). 

Findings Inconsistent with Earlier Research 

A few of our findings are ineonsistent with earlier research. For example, our results 
indieate a negative relationship between student achievement and the frequency with which 
teachers elicited the use of multiple strategies and solutions. Researeh previously cited shows, in 
contrast, that children benefit from inventing their own strategies and discussing a range of 
strategies for solving particularly demanding arithmetie problems. For example, the number of 
strategies discussed and applied by ehildren predicts their later learning (Siegler 1995). As 
another example, when learning to solve problems involving mathematical equivalence, children 
were most successful when they had passed through a stage involving their consideration of 
several solution strategies (Alibali et al. 1993; Siegler 1995). Thus, our finding may be an 
anomaly resulting from the low frequency of this behavior. Or, children who experienee the 
practice with limited frequency may not reach a skill level that allows them to consider different 
strategies and solutions. It may also be possible that eneouraging children to use several 
strategies eonfuses students or wastes time unless the teacher suceessfully elicits articulation and 
defense of strategies, extends students’ deseriptions of those strategies, expects students to 
provide reasons and justifications for why those strategies are mathematically useful and valid, 
and provides mathematical structure and language as necessary (Fraivillig et al. 1999). Teachers 
in this study may have been prompted by the eurrieulum assigned to them but may not have yet 
developed sueh a eomprehensive set of elicitation and support practices. Additional researeh is 
needed to disentangle these possibilities. 

A related matter is the issue of students’ interactions with one another; again, our results 
appear eontradictory to several earlier studies. We did find, however, that one measure of student 
interaction — students helping one another understand math eoneepts or proeedures — is positively 
associated with student achievement and consistent with previous research, which indicates that 
students benefit from interaeting with peers regarding mathematics, mathematical problems, and 
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their strategies and solutions, especially when the teacher builds expectations that students 
should help one another understand math concepts or procedures (Cobb and McClain 2002; 
Lampert and Cobb 2003; Stein et al. 2008; Johnson and Johnson 2009). Nonetheless, several 
other items we examined regarding peer collaboration are not associated with increased 
achievement. Indeed, “students more frequently asking each other questions” is associated with a 
decrease in student achievement. Generating multiple strategies and talking with peers takes 
time, and the amount of time spent on math instruction in the study classrooms may not have 
been sufficient for these practices to occur to a meaningful degree. Or, it may be that asking 
questions without getting answers is frustrating and unhelpful; that is, it may be that the 
explanations might make a difference (Fuchs et al. 1997; Nastasi and Clements 1991; Webb 
1984). Again, future research is needed to address these alternative hypotheses, and we 
recommend that no implications be drawn for practice until such issues are addressed. At this 
point, our results suggest that collaborative learning practices should follow research-based 
recommendations designed to ensure that collaborative time is productive (Fuchs et al. 2001; 
Greenwood et al. 1989; Johnson and Johnson 2009; Nastasi and Clements 1991). 

Conclusions 

Our results, together with the results of other studies, suggest there are aspects of 
mathematics instructional environments, including teacher, student, and peer-to-peer 
components, that are statistically related to student achievement. Specifically, Ist-grade student 
achievement was higher when Ist-grade teachers increased the time devoted to whole-class 
instruction and in classrooms in which teachers suggested specific strategies in response to 
students’ work. Second-grade student achievement was higher when 2nd-grade teachers used 
more representations of mathematical ideas, asked the class whether it agreed with a specific 
answer, encouraged students to help one another understand mathematics, and when teachers 
differentiated curriculum for students who were above grade level. 

Because individual instructional practices do not operate in isolation, and because teachers 
tend to use more than one practice, these findings suggest that it may be useful for future 
research to focus on the effects of combinations of instructional practices, including those 
viewed as aligned with different pedagogical styles (such as student-centered and teacher- 
directed). Instructional practices need not function as opposing pedagogical styles or practices 
(as the National Mathematics Advisory Panel originally posed the question, and as many 
observational measures are structured), but rather as synergistic components. Therefore, future 
research ought to progress beyond dichotomies such as “student-centered versus teacher-directed 
instruction” and instead investigate how a variety of approaches from both perspectives could 
play complementary functions, and at which grade levels and with what content each is more 
effective. As one example, a study of peer-mediated instruction (PMI) showed strong positive 
effects compared to teacher-directed instruction (Fuchs et al. 1997). However, when teachers 
provided instruction on methods of presenting conceptual mathematical explanations within 
PMI, the effects were even stronger. Thus, the two approaches worked synergistically to 
engender the highest achievement. Similarly, our results for 2nd grade suggest that students can 
profitably help each other with math concepts or procedures, but it may be beneficial if the 
teacher guides the curriculum (e.g., representations used and differentiation) and classroom 
routines. 
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Because teachers were randomly assigned to implement one of the study’s four curricula, 
which draw on the various instructional practices in different ways, and because implementation 
analyses presented in other study reports show that teachers tended to adhere to their assigned 
approach (Agodini et al. 2009, 2010), these study data do not provide a good opportunity to 
examine combinations of instructional practices outside of the four curricula. Therefore, we 
believe it would be more useful for future research to examine this issue. 

It also would be productive to investigate the effects of other features of classroom 
environments and teaching that are not classified by the above dichotomies, such as the extent to 
which teachers and students attend explicitly to concepts and the extent to which students are 
challenged to engage in and struggle with important mathematics concepts (Clements and 
Sarama 2012, Hiebert and Grouws 2007). 

Finally, in addition to looking at the effects of combined instructional practices, researchers 
could examine the difficulty of implementing various instructional practices. Recent work by 
Remillard (2012) focuses on the relative ease of implementing various curricula that embed 
combinations of practices. It could be instructive to further this line of research, along with 
research on the relative ease of implementing specific instructional practices. For example, our 
findings suggest that increasing the amount of math instructional time in a large group or whole- 
class setting is related to increased student achievement. Making this instructional change could 
be easy for many teachers. However, increasing the frequency with which students help one 
another understand math concepts or procedures — another practice positively associated with 
student achievement — could be more challenging for some teachers (particularly in some 
classrooms), in that it might require a higher level of pedagogical content knowledge than simply 
restructuring the class for more whole-class activities. Experiments on these issues would make a 
substantive contribution to both research and practice. 
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ENDNOTES 


' More details about this study design and the effeets of the eurrieula on student math 
aehievement are reported in Agodini et al. (2008, 2009, 2010, and 2013). 

2 

On average, the observation lasted 70 minutes per day and ineluded the math lesson and 
morning meeting. 

^ Information about inter-rater reliability is provided in the Appendix. 

We examined the relationship between student aehievement and specific practices because 
we believe it is more useful for informing future studies of instructional practices than examining 
relationships with the three scales. Specifically, because the scales were constructed from data 
collected for the first time with our custom-made observation protocol, we recommend that 
future research examines whether the scales underlying our protocol are robust across other 
samples of teachers prior to using them in this type of analysis. 

^ We do not focus on the relationship between the items in the classroom environment scale 
and student achievement because we did not find that this scale is related to achievement while 
working on the curriculum impact analysis. 

^ The ECLS-K bridge study was conducted to ensure that item overlap between the ECLS- 
K, K-1, and ECLS-K 3rd-grade items was adequate to place student achievement in a 
longitudinal scale (Pollack et al. 2005). 

^ The present study has a relatively high proportion of children of low socioeconomic status, 
and test results for the study’s fall 2006 Ist-grade sample showed mean math ability slightly 
below that of national ECLS-K fall 1st graders, by about one-eighth of a standard deviation. The 
selection of items included in the 2nd-grade test accounted for these factors. 

o 

The bivariate correlations between the items included in each of the three first-step 
analyses are reported in the Appendix, Tables A.7 through A. 12. 

^ The bivariate correlations between the items included in the second-step analysis are 
reported in the Appendix, Tables A.13 and A.14. 

On average, the observation lasted 70 minutes per day and included the math lesson and 
morning meeting. 

'' The Appendix also presents results from separate analyses for each instructional practice, 
indicating how each practice is related to student achievement without taking into consideration 
the influence of other practices and without adjusting for student, teacher, and school 
characteristics. A comparison of these results with those presented in Tables 3 through 5 
illustrates how the adjustments affect the simple correlations reported in the Appendix. 
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